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What is claimed is: 

1. A moving picture prediction system for predicting a 
moving picture to be implemented in at least one of an 
encoder and a decoder, the moving picture prediction 
system comprising: 

a plurality of memories for storing picture data for 

reference to be used for prediction, the plurality 
of memories corresponding to different transform 
methods, respectively; and 

a prediction picture generation section for receiving a 

parameter representing a motion of a picture segment 
to be predicted, and for generating a predicted 
picture using the picture data stored in one of the 
plurality of memories used for the picture segment 
to be predicted based upon the parameter and one of 
the transform methods corresponding to the one of 
the plurality of memories. 

2, The moving picture prediction system of claim 1, 
wherein the encoder generates a prediction memory 
Indication information signal indicating the one of the 
plurality of memories used for generating the predicted 
picture and transmits the prediction memory indication 
information signal and the parameter to a decoding 
station so as to generate the predicted picture using the 
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picture data stored in the one of the plurality of 
memories based upon the one of the transform methods 
corresponding to the one of the plurality of memories in 
the decoding station. 

3. The moving picture prediction system of claim l f 
wherein the decoder receives the parameter and a 
prediction memory indication information sinal indicating 
the one of the plurality of memories used for generating 
the predicted picture from an encoding station, 

wherein the prediction picture generation section 
generates the predicted picture using the picture data 
stored in the one of the plurality of memories based upon 
the parameter and the one of the transform methods 
corresponding to the one of the plurality of memories. 

4. A moving picture prediction system for predicting a 
moving picture to be implemented in at least one of an 
encoding and a decoding, the moving picture prediction 
system comprising: 

a plurality of memories for storing picture data for 

reference to be used for prediction, the plurality 
of memories being assigned to different parameter 
effective value ranges, respectively; and 

a prediction picture generation section for receiving a 
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parameter representing a motion of a picture segment 
to be predicted, for selecting one of the plurality 
of memories assigned to one of the parameter 
effective value ranges including a value of the 
5 parameter, and for generating a predicted picture 

using the picture data stored in a selected memory. 

5. A moving picture prediction system for predicting a 
moving picture to be implemented in at least one of an 
10 encoding and a decoding, the moving picture prediction 
system comprising: 

a plurality of memories for storing picture data for 

reference to be used for prediction; and 
a prediction picture generation section including 
15 a motion compensator for receiving a parameter 

representing a motion of a picture segment to 
be predicted, and for generating a predicted 
picture by using the picture data stored in the 
plurality of memories based upon the parameter, 
20 and 

a memory update unit for updating the picture data 
stored in at least one of the plurality of 
memories at an arbitrary timing. 



25 6. The moving picture prediction system of claim 1, 4, 
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or 5, wherein the moving picture is predicted in a moving 
picture sequence having first and second video objects, 

wherein the plurality of memories includes separate 
first and second pluralities of memories corresponding to 
5 the first and second video objects, respectively, and the 
prediction picture generation section includes separate 
first and second generators, respectively, corresponding 
to the first and second video objects, 

wherein the first generator uses the picture data 

10 stored in at least one of the first and second 

pluralities of memories to generate the predicted picture 
when predicting the first object, and generates 
information indicating a use of the second plurality of 
memories for predicting the first object, the information 

15 being added to the predicted picture. 

7. The moving picture prediction system of claim 1, 4 
or 5, wherein the prediction picture generation section 
generates the predicted picture through a change of 

20 either one of a number and a size of the plurality of 

memories in response to a change in the moving picture at 
each time instance, 

8. The moving picture prediction system of claim 1, 4 
25 or 5, wherein the prediction picture generation section 
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generates the predicted picture in a limited use of 
memories for prediction in response to a change in the 
moving picture at each time instance. 

5 9. The moving picture prediction system of claim 1, 
wherein the prediction picture generation section 
generates the predicted picture by calculating a 
plurality of the predicted pictures generated by using 
the respective picture data stored in the plurality of 
10 memories. 

10. The moving picture prediction system of claim 1 
further comprising: 

a significance detector for detecting a feature parameter 
15 representing a significance of the picture segment 

to be predicted, 

wherein the prediction picture generation section 
generates the predicted picture by selecting at least one 
of choices of at least one of a plurality of prediction 
20 methods, the plurality of memories, and a plurality of 
memory update methods. 

11. The moving picture prediction system of claim 1 or 5 
further comprising: 

25 a significance detector for detecting a parameter 
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representing at least one of an amount of bits 
available for coding the picture segment to be 
predicted, an amount of change of the picture 
segment at each time instance, and a significance of 
5 the picture segment; 

wherein the prediction picture generation section 
generates the predicted picture by selecting at least one 
of choices of at least one of a plurality of prediction 
methods, the plurality of memories, a plurality of memory 
10 update methods. 



12. The moving picture prediction system of claim 1 or 
5, wherein the moving picture is predicted on a video 
object basis, 

15 wherein the moving picture prediction system further 

comprising: 

a significance detector for detecting a parameter 

representing at least one of an amount of bits 
available for coding a video object to be predicted, 
20 an amount of change in the video object at each time 

instance, and a significance of the video object; 
wherein the prediction picture generation section 
generates the predicted picture by selecting at least one 
of choices of at least one of a plurality of prediction 
25 methods, the plurality of memories, and a plurality of 
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memory update methods. 

13. The moving picture prediction system of claim 1 or 5 
further comprising: 

5 a prediction information encoder for encoding prediction 
relating information of the moving picture; 
wherein the prediction picture generation section 
counts a number of times of a memory used for prediction 
and determines a rank of the plurality of memories based 
10 upon a counted number of the times, 

wherein the prediction information encoder allocates 
a code length to the prediction relating information to 
be encoded based upon the rank of a memory used for 
prediction. 

15 

14. The moving picture prediction system of claim 1, 
wherein the plurality of memories includes at least a 
frame memory for storing the picture data on a frame 
basis and a sprite memory for storing a sprite picture. 

20 

15. The moving picture prediction system of claim 14, 
wherein the sprite memory includes at least one of a 
dynamic sprite memory involving a regular updating, and a 
static sprite memory not involving the regular updating. 



25 
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16. The moving picture prediction system of claim 14, 
wherein the one of the transform methods corresponding to 
the one of the plurality of memories is at least one of a 
parallel translation, an affine transformation, and a 

5 perspective transformation in an interchangeable manner. 

17. A method for predicting a moving picture to be 
implemented in at least one of an encoding or a decoding, 
the method comprising the steps of: 

10 storing picture data for reference to be used for 
prediction in a plurality of memories; 
corresponding different transform methods with the 
plurality of memories, respectively; 

receiving a parameter representing a motion of a picture 
15 segment to be predicted; and 

generating a predicted picture using the picture data 

stored in one of the plurality of memories used for 
predicting the picture segment based upon the 
parameter and one of the transform methods being 
20 corresponding to the one of the plurality of 

memories. 

18. The method for predicting a moving picture of claim 
17, further comprising the steps of: 

25 generating a prediction memory indication information 
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signal indicating the one of the plurality of 
memories used for the picture segment to be 
predicted; and 

transmitting the prediction memory indication information 
signal and the parameter to a decoding station. 

19. The method for predicting a moving picture of claim 
17 to be implemented in the decoding, the method further 
comprising the step of: 

receiving a prediction memory indication information 
signal indicating the one of the plurality of 
memories used for generating the predicted picture 
and the parameter representing a motion of the 
picture segment to be predicted from an encoding 
station. 

20. A method for predicting a moving picture to be 
implemented in at least one of an encoding and a 
decoding, the method comprising the steps of: 
storing picture data for reference to be used for 

prediction in a plurality of memories; 
assigning separate parameter effective value ranges to 

the plurality of memories, respectively; 
receiving a parameter representing a motion of a picture 

segment to be predicted; 
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selecting one of the plurality of memories assigned to 
one of the parameter effective value ranges 
including a value of the parameter; and 

generating a predicted picture using the picture data 
stored in a selected memory. 

21. A method for predicting a moving picture to be 
implemented in at least one of an encoding and a 
decoding, the method comprising the steps of: 
storing picture data for reference to be used for 

prediction in a plurality of memories; 
receiving a parameter representing a motion of a picture 

segment to be predicted; 
generating a predicted picture using the picture data 

stored in the plurality of memories based upon the 

parameter; and 
updating the picture data stored in at least one of the 

plurality of memories at an arbitrary timing. 



